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EXTENSION OF FAST PHONG SHADING TECHNIQUE FOR BUMP MAPPING 



Background of the Invention 

Technical Field This invention relates to the field of computer graphics, and in particular 
5 to methods for implementing bump mapping in computer graphics. 

Background Art Computer images having realistic three dimensional appearances 
("3D images") are becoming increasingly prevalent in games, multi-media, and other graphics- 
heavy software. The methods employed to generate 3D images require processing power that 
Jj has only recently become available in personal computers. A standard method for generating a 
|4 3D image begins with sets of polygons that represent the surfaces of each object in the image. 

An object that has a moderately complex shape may require thousands of polygons to represent 
* T its surface, and an image that includes multiple objects may require tens or even hundreds of 
%i thousands of polygons. Illumination and orientation data for each of these polygons must be 
"4 processed and converted to pixel level data to generate a 3D image on a computer monitor. A 
¥s computer may have to process 50 million pixels (« .5 million polygons) per second to generate a 
3D image that includes multiple objects of moderate complexity. This places a significant 
burden on the processing power of the computer. 

Image processing is implemented by a 3D pipeline that typically includes a geometry 
stage and a rendering stage. In the geometry stage, the orientation of each polygon and the 
20 location of any light sources that illuminate the polygon are determined with respect to a 
reference coordinate system and specified by vectors associated with the polygon's vertices. 
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This vertex data is transformed to a coordinate system ("camera coordinate system") that 
facilitates viewing the image on a computer monitor and rotated to a desired orientation. In the 
rendering stage, the vertex data for each polygon is converted into the pixel level data necessary 
to represent the object on the computer monitor. Since there are tens to hundreds of pixels per 
polygon, rendering significantly slows the image generation process. 

The two dimensional (2D) image on the computer monitor obtains its 3D appearance 
through lighting and perspective effects implemented by the graphics pipeline. The 3D 
appearance of an object depends significantly on the shading method used to assign color values 
to the pixels of the polygons. Realistic 3D images require relatively sophisticated shading 
methods that determine color values on a pixel by pixel basis. Consequently, these shading 
methods are implemented during the rendering stage of the pipeline. 

The principal shading methods are, in order of increasing sophistication, flat shading, 
Gouraud shading, and Phong shading. Flat shading assigns the same color values to all the 
pixels in a polygon. Gouraud shading assigns color values to the pixels by interpolating from the 
color values at the vertices of the polygon. Phong shading assigns color values by interpolating a 
normal vector for each pixel from the normal vectors at the polygon vertices, and evaluating an 
illumination equation at each pixel using its interpolated normal vector. Phong shading and its 
variants are referred to as per-pixel shading methods, since the colors of an image are calculated 
for each pixel according to its orientation characteristics. These per pixel orientation 
characteristics are also necessary to implement bump mapping, which generates modified 
lighting features by perturbing the surface normal from its interpolated value. 
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Systems that generate fast, interactive graphics typically employ flat and Gouraud 
shading. These methods employ approximations in the rendering stage that are relatively cheap 
computationally, and the corresponding images can be generated in real time without elaborate 
graphics hardware. The images produced by these methods lack the lighting effects that 
distinguish quality 3D images, such as realistic specular highlights and diffuse light scattering. 
In addition, these methods are not amenable to bump mapping, since per pixel normal 
orientations are never determined. High end computer systems may include advanced rendering 
hardware to implement Phong shading. Even with high quality graphics hardware, the 
computational cost of Phong shading makes it difficult to generate real-time, interactive 3D 
images. 

There is thus the need for a practical implementation of per-pixel shading methods that 
are suitable for use in real-time, interactive 3D graphics applications and may be implemented 
without the need for sophisticated graphics hardware. 

Summary of the Invention 

The present invention provides per-pixel shading that is fast enough for real time 
interactive graphics applications and may be implemented using standard graphics hardware. 

In accordance with the present invention, color values are precalculated, collected in a 
color map, and referenced by orientation-dependent color variables. During rendering, per-pixel 
vector orientations are determined, modified according to a perturbation source, mapped to color 
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variables through a pair of angular coordinates, and pixel color values are provided by a 
corresponding entry in the color map. 

Brief Description of the Drawings 

5 The present invention may be understood with reference to the following drawings in 

which like elements are indicated by like numbers. These drawings are provided to illustrate 
selected embodiments of the present invention and are not intended to limit the scope of the 
invention. 

O Fig. 1 is shows the different vectors associated with a polygon to determine color values 

j 0 for the pixels of the polygon. 

Fig. 2 is a flowchart representing an overview of a per-pixel shading method in 
~ accordance with the present invention. 

, ri Fig. 3 shows the angle coordinates used to represent the orientation of a vector in 

q accordance with the present invention. 

15 Fig. 4 is a color map comprising color values that are referenced through corresponding 

color variables. 

Figs. 5A-5D are examples of color maps generated using the method of the present 
invention. 

Figs. 6A-6E are images generated using Gouraud shading, Phong shading, and the 
20 method of the present invention. 
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Fig. 7 is a coordinates system suitable for specifying light and halfway vectors when the 
light source is local to a polygon surface. 

Fig. 8 is a block diagram of a system for implementing the per-pixel shading method of 
the present invention. 

Fig. 9 is a block diagram of the system of Fig. 6 modified to implement a bump mapping 
method in accordance with the present invention. 

Figs 10-11 show images generated using a bump mapping method in accordance with the 
present invention. 

Detailed Description of the Invention 

The following discussion sets forth numerous specific details to provide a thorough 
understanding of the invention. However, those of ordinary skill in the art, having the benefit of 
this disclosure, will appreciate that the invention may be practiced without these specific details. 
In addition, various well known methods, procedures, and components have not been described 
in detail in order to focus attention on the features of the present invention. 

Fig. 1 shows the different vectors that are associated with a polygon P for implementing 
various illumination models. In the following discussion, vectors and matrices are represented 
by bold capital letters. P is shown as a triangle for purposes of illustration with the 
understanding that any type of convex, planar polygon may be used to approximate the surface of 
an object. Vectors N, L, V, and H are shown for an arbitrary set of surface coordinates (s, t) on 
P. N is a unit vector that is normal to P at (s, t). L is a unit vector at (s, t) that points toward a 
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light source illuminating P. V is a unit vector at (s, t) that points in the direction from which the 
object is viewed, e.g. the viewing or camera direction. H is a vector that is halfway between L 
and V. When normalized, H is given by (V+L)/|V+L|. H is convenient for determining the 
specular component of light at a surface location. 

The three vertices of P are characterized by unit normals Nl, N2, N3. These normals 
indicate the orientation of P at each vertex and are specified by a set of cartesian coordinates (n^ 
riy, n z ). The vertex normals may be generated in the geometry stage of a graphics pipeline or, 
more typically, provided with a model of the object. Although not shown in Fig. 1, the vertices 
of P may also be characterized by values of L and V. 

In Phong-type per-pixel shading methods, the orientations of vectors N, L, and H are 
estimated for each pixel from their corresponding vertex values. An illumination model is 
evaluated at each pixel using the estimated vectors, and the resulting color value is assigned to 
the pixel for display on the computer monitor. 

Equation (I) is representative of the illumination equations used to determine the color 
value of a pixel at a location (s,t). 



A'-l 



C(s,t) = X 

7-0 



M a L a j+ MdL$(ji(s,t)»Lj(s,t)) + M s L s j{j*WLj(s,0 

D(s,t,j) 



A 



Eq. (1) 



Here, M d , M s , and M a are characteristics of the object material for diffuse, specular, and ambient 
light, respectively, and L dj , L sj , and L aj are the diffuse, specular, and ambient components of light 
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source, Lj respectively. D(s,t,j) is the distance between light source Lj and the pixel at s,t, and A 
is the specular exponent of the material. 

Using Eq. (1) to generate a 3D image requires the repetition of a number of costly 
operations for each pixel of the image. Ignoring various approximations, N, L, and H are 
estimated for each pixel from their corresponding vertex values. Eq. (1) is then evaluated for 
each pixel, using the estimated vectors. This entails evaluation of dot products (N*L and N«H), 
one of which is raised to a power (A). In addition, interpolation does not preserve the unit length 
of the normal, so that square root and division operations must be implemented for each pixel 
normal. 

The computational overhead of Eq. (1) is thus large, and when implemented in the 
rendering stage of the graphics pipeline, makes real time interactive graphics impractical. This 
overhead can be reduced through various approximations. For example, cosine, square root, and 
inverse functions can be evaluated using look-up tables, which sacrifice accuracy for speed. The 
orientations of L and/or H can be treated as constant across the polygon, when the separation 
between the object and the light source or the viewer (camera) is relatively large. The object can 
be illuminated and viewed from the same direction, so that L and V (and thus L and H) are 
parallel, and N»L = N*H. This is a relatively common geometry in video games. Even with 
these strategies, Eq. (1) is still evaluated real time for each pixel, significantly slowing down the 
rendering process. The loss of accuracy can also produce noticeable defects in the resulting 
images. 

The present invention provides per-pixel shading that is suitable for generating 3D 
images in real-time, interactive applications, using commonly available graphics hardware. This 
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is accomplished by representing vector orientations through a pair of polar angle coordinates to 
simplify interpolation, scaling the angle coordinates to provide texture-like processing, and 
precalculating color values for a sample of normal vector orientations.. The color values are 
parameterized by one or more angle-dependent color variables, collected in a color map, and 
5 referenced by their corresponding color variables. The color map needs to be recalculated only 
when the geometry with which the object is lit or viewed changes. 

During rendering, angle coordinates of a vector, e.g. N, L, H, are determined for each 
pixel by interpolation from the values at the polygon vertices. Interpolation of the angle 
coordinates eliminates the need to renormalize the vector at each pixel. In addition, normal 
iffl perturbations ("bumps") are readily incorporated into the rendering process in the form of 
2 perturbations to the angle coordinates. The angular coordinates (with or without perturbations) 
S are converted to color variables, which map the vector orientations to a two dimensional array. 

The color variables reference illumination data in the color map that is appropriate for the 
"' relative light, camera, and normal vector orientations at the pixels. Thus, color values may be 
_1J provided during the rendering stage using a relatively fast look-up procedure. This approach 
may be used to shade objects for any number of light sources, and it may be used whether the 
light source(s) are near the object (local) or "infinitely" distant from the object (non-local). It 
may also be used whether the camera is local or non-local. 

Fig. 2 provides an overview of a method in accordance with the present invention for 
20 implementing per-pixel shading. At step 210, one or more color maps are generated, according 
to the properties of the object and the one or more light sources that illuminate it. Angle 
coordinates are then generated 220 for L, H, and N at the vertices of a polygon. Steps 210 and 
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220 are typically implemented prior to rendering. During rendering, angle coordinates are 
estimated 230 for the pixels of the polygon and converted 240 to color variables. A color value 
is assigned 250 to the pixel from the one or more color maps according to its color variable(s). If 
more polygons remain to be processed 260, vertex data for the next polygon is retrieved 270 and 
5 steps 230-260 are repeated. If no more polygons remain 260, processing for the object is done 
270. 

A detailed embodiment of the present invention is discussed first for the case in which the 
light source is non-local and the object is illuminated and viewed from the same direction (L and 
V are parallel). The modifications are then discussed for cases where V and L are not parallel 

0 and where multiple light sources are present. Finally, the modifications for the case of local light 

r! sources and cameras are discussed. 

*f One feature of the present invention is the use of a two variable, polar coordinate system 

L (angle coordinates) to represent vector orientations, instead of the conventional three variable, 
k;- cartesian coordinate system. As noted above, the angle coordinates can be interpolated without 
*B altering the normalization of the corresponding vector, and they provide uniform coverage of 
vector orientations using linear interpolation methods. They also simplify specification of 
relative vector orientations. The angle coordinates are linearly related to orthogonal color 
variables that range between 0 and 1 . The color variables reference color values in a 
precalculated color map in much the same way that texture variables reference texture values in a 
20 texture map. 

For one embodiment of the invention, the angle coordinates of a normal vector are 
mapped to a two dimensional (2D) grid of color variables, and color values are assigned to pixels 
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from a color map that is referenced to the same color variable grid. The color map for this 
embodiment may contain light contributions from one or more light sources. For non-local light 
sources, angle coordinates specifying the relative orientation of the normal and light vectors are 
mapped to a one dimensional table of color variables, and color values are assigned to pixels 
from a one dimensional color map that is referenced to the same color variable table. The one 
dimensional color map represents light contributions from a single light source. One 
dimensional color maps for multiple light sources may be combined to form a 2D color map in 
which color values are referenced through a color variable and a light source identifier. In each 
case, the color mapping may be implemented using modified texture mapping techniques and 
hardware. 

Fig. 3 illustrates angle coordinates suitable for representing the orientation of a vector, 
e.g. vertex normal N, in accordance with one embodiment of the present invention. In this 
coordinate system, L is a unit vector that is directed towards a light source. L, LI, and L2 form 
the basis vectors for a cartesian coordinate system 300 in which a normal N is specified. SI is a 
vector representing the projection of N onto a plane formed by the L and LI basis vectors ("L-Ll 
plane"). A first angular variable, a, is defined as the angle between N and SI. A second angular 
variable, p, is defined as the angle between SI and LI. In the disclosed coordinate system, a 
ranges from 0 to 7t/2 and (5 to range from 0 to n. 

For one embodiment, color variables u c and v c are related to a and P through the 
following relationships: 
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5-alnif (N#L 2 )>0* 
5+a/7rif (N«L 2 )<0 



Eq. 2a 



'/31k // (N*L)>0' 
1-/?/;t//(N#L)<0 



Eq. 2b 



A color map for this case (L = V, light source at infinity) may be precalculated in terms 
of the color variables as follows: 



Here, Q L (u c , v c ) and Q H (u c , v c ) are functions of color variables, u c and v c , representing a range of 
normal orientations. For the above example, where L and H are parallel, £2 L (u c , v c ) and Q L (u c , v c ) 
are equal and are the orientation-dependent portion of Eq. 3 becomes (M d L d + M s L s ) Q(u c , v c ), 
where Q(u c , v c ) is given by: 



Here, the subscript has been dropped from Q. Fig. 4 shows color maps 400, 401, 402, 403 
calculated using Eq. 4 with different values of the specular exponent A. In accordance with the 
present invention, color maps 400-403 are precalculated and referenced through color variables 
u c and v c . 

In order to assign color values from, e.g., color map 400 to the pixels representing the 
illuminated object, color variables are determined for each pixel of the component polygons. 
The starting point for determining pixel color variables for a given polygon is the angle 
coordinates a, p of the polygon's vertex normals. Vertex values of the angle coordinates may be 
determined using standard transformation techniques, as discussed below in greater detail. 




Eq. 3 



Q(u c? v c ) = cos[7r(.5 + u c )] sin[27iv c ] = sin[7iu c )] sin[27tv c ]. Eq. 4 
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During rendering, angle coordinates a, p are generated for each pixel from the corresponding 
vertex normal values. The angle coordinates a, p for each pixel are then converted to color 
variables u c , v c , and a corresponding color value is provided from color map 400. 

Illumination data related to other vectors quantities may be readily accommodated in 
5 color map 400. For example, when V and L are not parallel, the orientation function, Q H (u c , v c ) 
differs from £\(u c? v c ) and must be determined independently. The orientation of H in the 
coordinate system of Fig. 3 may be specified by angular coordinates, a H , p H (or corresponding 
color variables u cH , v cH ), and the corresponding orientation function is given by: 

n H (u c , v c ) = sin[7i(u c - u cH )] sin[27i(v c - v cH )]. Eq. 5 

14 Since u cll and v cII are constants for a given illumination/viewing geometry, the sum of M s L s Q H (u c , 
^ v c) M d L d Q L (u c , v c ) be referenced through the same color variables to form a color map for the 
case where L and H are not parallel. 

J;1 Similarly, where multiple light sources are present, the orientation of each additional light 

% j source, L i9 may be specified through angle coordinates, a Li , P Li (or their corresponding color 
ifiS variables, u cLi , v cLi ). Diffuse terms for each additional light source may then be incorporated into 
color map 400 through a corresponding orientation function, Q Li (u c , v c ), in which u c , v c , are offset 
by constant color variables, u cLi , v cl i as in Eq. 5. Specular terms for each additional light source 
^ni( u o v c) ma Y t> e similarly incorporated for each L { that is not parallel to H. 

One shortcoming of the coordinate system of Fig. 3 is that close normals may not 
20 correspond to close color texture coordinates. For example, if the viewing direction (V) 

corresponds to color variables near the edge of color map (Fig. 3), small changes in the viewing 
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direction of the object may result in large changes in the color variables for normals on opposite 
sides of the origin (e.g. p = 0). This can create a discontinuous appearance in those regions of 
the object that correspond to extreme color variables of the color map. 

One method for addressing these discontinuities is to employ a coordinate system in 
5 which the defects, e.g. discontinuities, are on polygons on the side of the object opposite to that 
being viewed, independent of the location of the light source(s). This may be accomplished, for 
example, in a coordinate system in which the normal angles are defined relative to the camera 
(viewer) direction rather than light source direction. In Fig. 3, this means that L is replaced by 
V, and the angle coordinates a, (5 refer to the direction of a normal or a light source, L i5 with 
13 respect to V. 

As in the discussion of color map 400, a color map in the camera-fixed coordinate 
|: system is generated by sampling a range of normal orientations specified by, e.g., angle 

coordinates, a, p. The set of sampled normals defines a unit sphere. The hemisphere visible to 
^ the viewer is mapped to a planar grid as follows: 

U Eq. 6 

For one embodiment, the 2D color map or table includes diffuse lighting contributions from all 
light sources as a function of normal orientations specified by u c , v c . For specular lighting 
purposes, it is assumed that the central element of the 2D table V2) represents a normal 
pointing directly into the camera. Thus, H can be established and specular contributions can be 
20 determined and added for all lights. 
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During rendering, the orientation of a pixel normal is interpolated from vertex values of 
a, (3, and converted to color variables u c , v c . The pixel color value is provided by the entry in the 
2D table referenced by u c , v c . It is noted that since each pixel is treated independently, there are 
likely to be parallax errors, and pixels in shadow may be lit as if they were not in shadow. 

A color map for multiple, non-local lights illuminating a polygon characterized by one 
set of material properties in the viewer-referenced coordinate system is calculated as follows: 

Eq. 7a 

Eq. 7b 

Here, L } and Hj are the light source and halfway vectors for light source (j) in the viewer- 
referenced coordinate system. For one embodiment of the present invention, N x [u c ,v c ] and 
N y [u c ,v c ] are a set of vectors that sample a range of orientations with respect V. N x [u c ,v c ] and 
N y [u c? v c ] are given by the following equations: 



N J"c> v c] = 



Jl *1 j 



if(xl + yl)<\ Ec *- 8a 
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N,[w c ,v £ 




otherwise 



Eq. 8b 



N y[" c v c ] = 



if(xl+yl)<\ E£ i- 9a 



N >["c v c] = 




x 2 +v 2 



otherwise 



Eq. 9b 



In this embodiment, the color variables, u c , v c are related to x u , y v as follows: 



y v =2 Vc -\ Eq. 10b 



The color map consists of the set of color values C^u^vJ and C 2 [u c ,v c ] for color variables 
u c; v c between 0 and 1 . The geometry intensive calculations of Eqs. 7a and 7b, are precalculated, 
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e.g. prior to rendering, for each object that has the same lighting, camera, and material 
characteristics. 

Figs. 5A and 5B are color maps, C 1 and C 2 , respectively, for the following material and 
light source characteristics for red, green, and blue (RGB) wavelengths: 

5 M, = (0.15, 0.03, 0.12) 

M d = (0.7, 0.12, 0.40) 
M, = (1.0, 1.0, 1.0) 

A mat = 40 

L,(0) = L d (0) = L s (0) = (1,1, 1) (white light) 
U L a (l) = L d (l) = L s (l) = (0, 0, 1) (blue light) 

% M a , M d , and M s are material RGB color vectors for ambient, diffuse, and specular light, A mat is 
ih the specular exponent of the material, and L a (j), L d (j), and L s (j) are RGB color vectors for light 
w source (j)- 

%\ Figs. 5C and 5D are color tables C 1 and C 2 for the following material and light source 

IS RGB characteristics: 

M a = (0.12, 0.09,0.03) 
M d = (0.4, 0.37, 0.06) 
M s = (1.0, 0.80, 0.30) 
A mat = 40 

20 L a (0) = L d (0) = L s (0) = (1,1,1) (white light) 
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L a (l) = L d (l) = L s (l) = (0, 0, 1) (blue light). 



L a (2) = L d (2) = L s (2) = (0, 1, 0) (green light) 



Lo = (l,l,-l),L,= (-1,-1,-1), L 2 = (1,-1,-1). 



Once the color map is calculated for given light source(s) and viewing geometry, angle 
5 coordinates are generated for the vertex vectors (N, L, H) of each polygon in the viewer-fixed 
coordinate system. Angle coordinates for pixel normals are then generated by interpolation from 
the vertex values and converted to corresponding color variables. Color values for the pixels 
may then be read from the color map through a relatively fast look-up operation. 

q For one embodiment of the present invention, vertex values of the angular coordinates in 

m the viewer-fixed coordinate system are generated as follows. Let M = {M mn } represent a model 
g i view matrix for the object that is being imaged, and n^, n^, represent the x, y, and z 

components of the normal vector of the i th vertex of a polygon (iij). The model view matrix is the 
O matrix that transforms the coordinates of points in the object from an object-fixed coordinate 
^- system (model coordinate system) to a camera-fixed coordinate system (view coordinate system), 
jj In the latter coordinate system, V is parallel to the z axis, and the x and y axes are in the plane of 

the computer monitor. In this embodiment, a normalized vertex normal m in the camera-fixed 

coordinate system is given by: 



||M • n| 



Eq- (11) 



The color variables of the i vertex normal in this coordinate system are: 



20 



u ci = m xl > v ci = m vi > w ci = m zi E q- 0 2 ) 
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The color variables for the polygon pixels may be generated from {m xi , m yi , m 7i } using 
standard interpolation methods. These methods are described, for example, in Foley, van Dam, 
Feiner, and Hughes, Computer Graphics Principles and Practice, Addison Wesley, Reading 
Massachusetts (1996). 

5 In the disclosed embodiment of the invention , the color value for a pixel is provided 

from color map C 1 or C 2 , depending on the interpolated value of m^ A color value is assigned to 
the pixel from C 1 when m z > 0, and a color value is assigned to the pixel from color table C 2 
when m z < 0. C 2 is included in the discussion for completeness, since pixels that are mapped to 
color map C 2 are not visible when the object is transformed to the camera coordinate system 
© described above. 

a Figs. 6A-6E show a series of images generated using the method of the present invention. 

For comparison, the same images generated using Gouraud shading and Phong shading are 
^ shown adjacent to them. The method of the present invention allows the figures to be generated 
y= in approximately the same amount of time as required for the Gouraud shaded object, and in 

much shorter times than required for the Phong object. The images in Figs. 6A-6E generated by 
the present invention have highlights that are superior to those of the corresponding Gouraud 
shaded images and comparable to those achieved using the far more expensive Phong shading 
technique. 

Local lights are not readily treated with the color maps described above, since the 
20 orientation of the light source vector varies with pixel position in the polygon. Color maps in 
which only normal vector orientations are sampled, e.g. Figs 4 and 5, are inadequate when the 
light vector varies as well. Color maps that sample both normal and light vector orientations are 
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expensive to calculate and require four color variables to reference one color value. Since the 
color value depends only on the relative orientation of N and L (when L and V are parallel), the 
computational cost of the four parameter color map unnecessary. The use of four color variables 
also eliminates the parallels with texture mapping provided by the present invention. 

For one embodiment of the present invention, local lights are treated using a one 
dimensional color map for each local light source. Returning to Fig. 4, it is evident from the 
symmetry of color map 400 that a significant amount of redundant information is present. This 
follows from the fact that the only angle of significance in Eq. (4) when L and V are parallel is 
the angle y between L and N (Fig. 3). For example, Eq. 4 for Q(u c , v c ) is equivalent to: 

Cos y = Cos a • Sin p. Eq. 13 

A corresponding ID color map may be generated from Eq. 8, with Q(u c , v c ) = Cos y. 

Color values can not be determined unambiguously by interpolating y because vector 
orientations require two angles to be fully specified. However, angle coordinates a and (3 can be 
interpolated for each vector of interest, and y (or some function of y) can be generated using Eq 
12. Color values may be accessed from the one dimensional color map through y or a 
corresponding color variable. For multiple local light sources, a one dimensional color map may 
be generated for each light source/material combination, with color values referenced by a 
corresponding color variable. The set of one dimensional color maps may be combined into a 
single two dimensional color map, with color values indexed by a color variable and light source 
ID. Since the composite color map is 2 dimensional, it is readily accommodated into the color 
(texture) mapping framework of the present invention. 
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Fig. 7 shows a reference coordinate system defining angle coordinates a,, p, and a 2 , P 2 
specifying the orientations of N and L , respectively, across a polygon. A similar approach 
applies to determining the relative orientation of N and V for the specular component of Eq. (1). 
In the disclosed coordinate system, Z is one of the basis vectors and Y is an axis that is 
5 perpendicular to Z. S : represents the vector formed by projecting N onto the Z, Y plane and a x 
is the angle between N and the Z, Y plane. S x also makes an angle $ } with the Y coordinate axis 
in the Z, Y plane. Similarly, S 2 represents the vector formed by projecting L onto the Z, Y 
plane, a 2 is the angle between L and the Z, Y plane, and (3 2 is the angle between S 2 and the Y 
coordinate axis in the Z, Y plane. 

W Using the reference coordinate system of Fig. 7, and the angle pairs <x l9 p! and a 2 , p 2 , the 

vertex orientation of N and L may be specified unambiguously and interpolated to generate angle 

|= pairs a,(s,t), P^t) and a 2 (s,t), p 2 (s,t), respectively, for pixels at locations (s, t). At each pixel 
location (s,t), angle pairs Aoc(s,t) (= a { (s 9 t) - ot 2 (s,t)) and Ap(s,t) (= frfot) - P 2 (s,t)) are 

y determined. Since Aa(s,t) and Ap(s,t) are perpendicular to each other, Cos y is given by Cos Act 

if Sin Ap, perEq. 12. 

Where both local and non-local light sources are present, a single color map may be 
determined for all non-local light sources in the manner described above, and a separate color 
map may be provided for each local light source. In each case, the color maps are precalculated 
for a sample of color variables and referenced according to the color variables. Color 
20 contributions for each pixel are then determined by interpolating the angle coordinates for each 
pixel in a polygon from the vertex values, determining corresponding color variables, and 
assigning the referenced color values from the appropriate color map. 
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The parallels between the present invention and texture mapping allows per-pixel shading 
to be implemented using standard, textures mapping hardware without perspective correction. In 
the present invention, the color map corresponds to the texture map that is being mapped to a 
polygon surface, and orientation parameters u c , v c that reference color values in the color map 
5 correspond to the texture coordinates u T , v T that reference texture values in the texture map. 
Where the graphics system supports more than one pipeline, per-pixel shading in accordance 
with the present invention can be carried out in parallel with texture mapping. 

Fig. 8 is a block diagram indicating how the per-pixel shading method of the present 
invention may be implemented using texture mapping hardware available in most graphics 
:jf systems. For purposes of illustration, each polygon vertex has associated color variables, u c , v c 
\\Z w o corresponding to the angle coordinates of vertex vectors N, L, and H, as required by the 
"~ particular illumination model, geometry, and simplifying assumptions. These parameters may be 

determined in the geometry stage of the graphics pipeline or, in the case of the normal vectors, 
N specified in a model. Each polygon vertex is also shown having associated texture variables i^, 
\i v t , and w t for the case where texture mapping is implemented. 

Color variables u(s,t) c , v(s,t) c w(s,t) c , are generated for each pixel location from the vertex 
values using the interpolation methods discussed above or their equivalents. The interpolated 
orientation parameters of a pixel are then used to access a color value stored in color map 820. 
The color value is provided to a color combining module 830 for further processing. Depending 
20 on the mix of local and non-local light sources, color values may be provided from different 
color maps 820. 
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Similarly, texture variables u(s,t) t , v(s,t) t , and w(s,t) t . at pixel location s, t are generated 
from the vertex texture values, using standard interpolation methods. The interpolated texture 
values are then used to access texture data from texture map 840. The accessed texture map 
values are then provided to color combining module 830. Color combining module 830 receives 
5 per-pixel shading and texture data from color map(s) 820 and texture map 840 and combines the 
received shading and texture data into a suitable shading value for the pixel. 

The per-pixel shading method of the present invention may also serve as the basis for an 
efficient approach to bump mapping. This approach to bump mapping employs a perturbation 
source, such as a mathematical function, an algorithm, or a bump map, to alter the angle 
© coordinates (or color variables) of pixel normals before referring to the color map(s). For one 
;Z embodiment of the invention, the perturbation source generates orientation perturbations, Aa, 
£ A|3, that may be combined with the angle coordinates of a pixel to generate "perturbed angle 
s coordinates". The perturbed angle coordinates are converted to color variables, which reference 
; ^ color values representing the perturbed normal orientation. 

S Fig. 9 is a block diagram of a system 900 for implementing bump mapping in accordance 

with the present invention for the case in which the perturbation source is a bump map. System 
900 includes a bump map 910, a perturbation generator 920, a color map 930, and a color 
combining module 940. Also shown is an optional texture map 950. Color map 930 and color 
combining module 940 are substantially as shown and described in conjunction with Fig. 8. 

20 Bump map 91 0 is a precalculated set of orientation perturbation values (Aa, A(3) that are 

referenced through bump coordinates, P u , P v , P w . P w is shown in parenthesis since it is used only 
when perspective correction is to be included. 
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Pixel values of the bump coordinates are interpolated from vertex values of the bump 
coordinates during rendering. A bump value (Act, Ap) referenced by the interpolated bump 
coordinates is provided from bump map 910 for combination with the angle coordinates of the 
pixel. The perturbed angle coordinates are converted to color variables and the corresponding 
color values are provided by the color map. 

In the embodiment of Fig. 9, perturbation generator 920 combines bump values (Act, AP) 
with angle coordinates (a, p) for a pixel to generate perturbed angle coordinates (a' = a + Aa, 
p 5 = P + Ap). The perturbed angle coordinates are converted to color variables, which are then 
used to look up a color value in color map 930. The resulting color value is suitable to the 
perturbed orientation of the pixel's normal vector. As shown in Fig. 9, texture values may also 
be provided for a pixel from texture map 950 and combined with the color values from color map 
930 by color combining module 940. 

As noted above, sources other than a bump map may be used to provide the perturbations 
of the pixel normals. For example, one algorithm for generating perturbations computes the 
gradient of the color values for an image and converts the gradient to a bump value. Bump 
values may be generated and added to angle coordinates on the fly or they may be stored to a 
bump map and combined with angle coordinates on a subsequent pass through the image. 

Fig. 10 shows images 1010 generated by applying the bump mapping method of the 
present invention. The image on the left is generated using the pixel color values of the central 
image for the altitudes (bumps) of its corresponding pixels. The image on the right is generated 
using color-weighted altitudes (linear combinations of the RGB values) derived from the pixel 
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color values of the central image. Fig. 1 1 shows a series of images in which microrelief has been 
added using the bump-mapping method of the present invention. 

There has thus been provided a per pixel shading system that is suitable for use in real 
time interactive graphics systems. Color values are precalculated for a sample of normal vector 
orientations specified by pairs of polar angle coordinates. The color values are collected in a 
color map and referenced by angle coordinates that have been scaled to a range of between 0 and 
1 (scaled angle coordinates or color variables). Values of the angle coordinates are determined 
for the vertices of each polygon used to model the object to be shaded. During rendering, pixel 
angle coordinates are determined by interpolating angle coordinates from the vertex values. 
Bump features are generated by combining angle perturbations with the interpolated angle 
coordinates to generate modified angle coordinates. The angle perturbations for a pixel may be 
determined by interpolation from vertex values. The modified angle coordinates are converted to 
color variables, and a color value referenced by the color variables is assigned to the pixel. The 
method may be readily implemented using standard texture mapping hardware. 

We claim: 
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1 1 . A method for implementing bump mapping, comprising the steps of: 

2 generating a table of color values referenced by orientation-dependent color 

3 variables; 

4 estimating angle coordinates for a pixel in a polygon; 

5 modifying the estimated angle coordinates, using a perturbation source 

6 converting the modified angle coordinates to one or more color variable; and 

7 assigning the pixel a color value according to the one or more color variables. 

H 2. The method of claim 1, wherein modifying the estimated angle coordinates includes: 

:;J2 generating angle perturbations; and 

; !" 3 adding the angle perturbations to the angle coordinates. 



Cl 3. The method of claim 2, wherein generating angle perturbations comprises: 

2 estimating a bump variable for the pixel; and 

3 converting the bump variable to angle perturbations. 

4 

1 4. The method of claim 3, wherein converting the perturbation variable comprises retrieving 

2 angle perturbations from a bump map location referenced by the perturbation variable. 



P4661 26 



5. The method of claim 1, wherein estimating angle coordinates comprises: 

determining angle coordinates for normal vector orientations at vertices of the 
polygon; 

interpolating angle coordinates for the pixel from the determined angle 
coordinates. 



6. The method of claim 3, wherein estimating the perturbation variable comprises: 

determining perturbation variables for vertices of the polygon; 

interpolating perturbation variables for the pixel from the determined vertex 
perturbation variables. 



7. A graphics system comprising: 

a geometry engine to associate vector orientation data with vertices of one or more 
polygons representing an object in an image; 

a color map including color values for a sample of vector orientations, each color 
value being referenced by one or more orientation dependent color variables; 

a perturbation source to provide orientation perturbations; and 

a rendering engine to convert vertex data for each polygon to angle and 
perturbation coordinates for each pixel in the polygon, generate one or more perturbed 
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9 color variables using the angle and perturbation coordinates, and assign a color value to 

10 each pixel according to its one or more color variables. 

1 8. The graphics system of claim 7, wherein the orientation-dependent color variables are 

2 linearly related to angle coordinates that specify the sampled vector orientations. 

1 9. The graphics system of claim 7, wherein the perturbation source is a bump map 

2 including angle perturbations referenced by the perturbation coordinates. 

H 10. The graphics system of claim 9, wherein the rendering engine includes a generator that 

'2 combines the angle coordinates and angle perturbations into perturbed color coordinates. 



kl 1 1 . The graphics system of claim 7, wherein the perturbation source is an algorithm for 

C2 associating perturbations with polygon locations according to a property of the image. 

1 12. A machine readable medium on which are stored instructions that are executable by a 

2 system to implement a method for assigning a color value to an image pixel, the method 

3 comprising: 

4 generating color values for a sample of normal vector orientations, each color 

5 value being associated with one or more scaled angle coordinates representing a 

6 corresponding normal vector orientation; 
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7 estimating one or more angle coordinates for the pixel; 

8 perturbing the one or more angle coordinates to provide modified angle 

9 coordinates; and 

10 retrieving a color value for the pixel according to the perturbed angle variables. 

1 13. The machine readable medium of claim 12, wherein perturbing comprises: 

2 generating angle perturbations for the pixel; and 

3 combining the angle perturbations with the angle coordinates to form modified 
3 angle coordinates. 



H 14. The machine readable storage medium of claim 12, wherein estimating comprises: 

■IB- -- 

€3 interpolating angle coordinates for the pixel from angle coordinates for the 

•H3 polygon vertices; and 

converting the interpolated angle coordinates to scaled angle coordinates. 

1 15. A graphics system comprising: 

2 means for associating vector orientation data with vertices of one or more 

3 polygons representing an object in an image; 

4 means for indicating color values for a sample of vector orientations, each color 

5 value being referenced by one or more orientation dependent color variables; 
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6 means for providing orientation perturbations; and 

7 means for converting vertex data for each polygon to angle and perturbation 

8 coordinates for each pixel in the polygon; and 

9 means for combining angle and perturbation coordinates to provide a color value 
10 for each pixel through perturbed color variable. 



1 16. The graphics system of claim 15, wherein the providing means is a bump map including 

2 angle perturbations referenced by the perturbation coordinates. 



H 17. The graphics system of claim 16, wherein the combining means includes a generator that 
% combines the angle coordinates and angle perturbations into perturbed color coordinates. 
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EXTENSION OF FAST PHONG SHADING TECHNIQUE FOR BUMP MAPPING 

Abstract of the Disclosure 

A method for implementing bump mapping is provided that is fast enough to be used 
with real time interactive graphics products. Computationally expensive color values are 
precalculated for a sample of normal vector orientations as a function of orientation-dependent 
color variables, collected in a color map, and referenced through the color variables. The color 
variables are linearly related to angle coordinates that specify the normal vector orientations in a 
selected coordinate system. Angle coordinates are determined for the vertices of the polygons 
representing the object to be imaged. During rendering, the vertex angle coordinates are 
interpolated to provide pixel angle coordinates. Modified angle coordinates are generated by 
combining the angle coordinates with angle perturbations provided by a perturbation source, and 
converted to color variables. Color values referenced by the color variables are assigned to the 
corresponding pixels. 
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